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1. Introduction 

Hemodynamic priors in the MEG/EEG inverse 
problem promise to raise spatial resolution, as fMRI 
maps have a resolution in the mm range [1]. On the 
other hand, MEG/EEG data could add information 
about the temporal dynamics of the underlying brain 
activity. 

To achieve a combination of these modalities, the 
results of an fMRI analysis shall be used as 
constraints in the subsequent EEG/MEG source 
reconstruction. Doing this, one has to keep in mind 
that there are differences in the anatomical 
phenomena and in the necessary experimental 
setups. As a result, locations of significant 
hemodynamic differences (which we shall call 
“hotspots” subsequently) must not simply be 
equated with current sources. Instead, several 
problematic constellations may occur: 

• Current sources that do not show up in the fMRI 
images. 

• fMRI hotspots without a corresponding current 
source. 

• A slight displacement between fMRI hotspot 
and source location. 

We propose two strategies for the integration of 
fMRI with source reconstruction techniques that 
address these difficulties. One strategy has been 
developed for the dipole fit methods and another for 
distributed source models. 

2. Methods 

2.1 Dipole models 

Dipole models lead to an optimization problem like 
min A(j) = ||C(m — L j)|| (1) 

Here, m are the measured data, j are the unknown 
dipole components for given locations r, L is the 
(linear) lead field matrix for given locations r, and 
C is a sensor weighting matrix, m and j may 
comprise several time points. For given locations r, 
A and thus j can be computed non-iteratively using 
linear algebra, while an iterative solver has to be 
used for finding the optimal r. 

For fMRI-constrained dipole models, rotating or 
fixed dipoles are associated with each fMRI hotspot. 
To this end, the hotspots are used as seed points for 


the dipole fit, while a maximum distance constraint 
applies. Dipole locations, components, and time 
courses are fitted. In order to account for 
unexplained data, an additional dipole is fitted, 
which is not related to any hotspot (Figure 1). A 
regularized solution is obtained that is an extension 
to Eq. 3 in the sense that it suppresses source 
components with small data overlap [2] and that a 
penalty term P is added, which assures that the 
maximum distance criterion is met. The resulting 
optimization problem is: 

min A(j) = ||C(m - L j) f + X\\W overlap j|| 2 + P (2) 


The vicinity constraint for N sources and seed points 
s /? and maximum distances d t is imposed using the 
penalty term 



for 
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r. — s • < d, 


c»A (3) 


Again, the optimization problem can be solved 
analytically for given locations r. In the scope of 
this paper, d t = 5 mm is used. 



Figure 1: Schematic drawing for three hotspots and 
a total of four dipoles: dipoles are loosely fixed to 
fMRI hotspots, using the hotspot locations as seeds 
and constraining the dipoles to stay within a 
maximum distance from their seed points. One 
additional dipole is fitted, which is not tied to a 
hotspot. 


2.2 Distributed source models 

For fMRI-constrained distributed source models, the 
cortical sheet segmented from sMRI is used as the 
source space [3], resulting in some ten thousand 
fixed locations and normals with distances of 2 to 
3 mm. At each of these cortical locations, a dipolar 
source is assumed that accounts for the neuronal 
activity of the small surrounding patch. The 
orientation of the source is fixed to the pyramidal 
cell orientation, i.e. perpendicular to the cortical 
surface. 
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Figure 2: a) A middle layer of the gray matter sheet 
used as the source space for current density 
reconstructions (detail). Current dipoles are 
computed at each vertex location. Their orientations 
are normal with respect to the triangulated surface; 
b) Spatial relation between cortical sheet, fMRl 
hotspot, and the somewhat larger area of increased 
location weights. 

A depth-normalized, regularized inverse solution 
with a minimal weighted Z 2 -norm of the source 
strengths is computed: 

min A(j) = ||C(m - Lj) || + A||w^j || (4) 

The first term is the data term. It measures the 
discrepancy between measured and forward 
calculated data. 

The second term is the model term. It measures the 
discrepancy between the computed currents and an 
implicitly assumed model. Here, W imri is the 
diagonal fMRI-induced location-weighting matrix, 
and W depth is the diagonal depth normalization 
matrix common to weighted least squares methods. 
The location weights Wjmri depend on the fMRI- 
induced significances. Different weighting functions 
can be used (Figure 3a). In the scope of this paper, 
different weight factors are applied, while locations 
are either identified as hotspots (significance 1.0) or 
not (significance 0.0). Unconstrained solutions are 
obtained if W )mri = 1. 




fMRl significance 


Figure 3: a) Relation between fMRl significance and 
weighting factor for a given location, a: fMRl 
hotspots are enhanced by a factor of 1.4; b: factor 
of 2.0; c: fMRl hotspots are enhanced as a function 
of their significance; b) Simulation setup with 61 
electrodes and source plane. 



3. A simulation study 

In order to test the constrained source reconstruction 
methods, forward calculated 61 electrode EEG data 
source (Figure 3b) were generated for three dipolar 
sources. Each source showed a depolarization / 
repolarization sequence as activation pattern. Noise 
was added to achieve an SNR of 15 for the dipole 
fits and SNR’s of 30 to 8 for the current density 
reconstructions. Functional MRI data were 
simulated with three hotspots. Two of these hotspots 
coincided with two of the three source locations, 
while one hotspot had no corresponding source 
(Figure 4). 



Figure 4: a) Three simulated fMRl hotspots (black); 
b) Three simulated sources (black). From left to 
right: sources 1, 2, and 3; c) Source waveforms. 


3.1 Dipole fit results 

In all 4-dipole fits, three dominating sources at the 
correct locations were found. Sources 1 and 2 
interfere slightly in the rotating dipole fits but not in 
the fixed dipole fits. Results are shown in Figure 5 
and Figure 6. 

a) b) 



Figure 5: a) Fit results of 4 rotating dipole fit 
(black) and fMRl hotspots (seeds, gray); b) Rectified 
time courses of the 4 rotating dipoles. Time courses 
are all positive; source orientation reverses instead. 
The fourth source is the one at the third hotspot. 
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Figure 6: a) Results of 4 fixed dipole fit; b) Time 
courses of the 4 fixed dipoles. The fourth source is 
the one at the third hotspot. 

a) b) 



Figure 7: a) Results of fMRI-constrained MNLS 
current density reconstruction (SNR = 15, clipped) 
and simulated source locations (shown as small 
black spheres); b) Results of unconstrained MNLS 
current density reconstruction (SNR = 15, clipped) 

3.2 Current density results 

In the fMRI-constrained Minimum Norm Least 
Squares (MNLS) current density solutions, all 
source locations were retrieved when using a weight 
factor of 1.4. However, the time courses of sources 
1 and 2 interfere. Results are shown in Figure 7a). 
For comparison, the results of an unconstrained 
solution with W )mri = 1 are shown in Figure 7b). 
Over the range of weight factors between 1.0 
(unweighted) and 10.0 (strongly weighted), a 
transition from unconstrained results (data driven) to 
a mere reflection of hotspot locations (constraint 
driven) can be observed. 

For all methods [4] and SNR’s, however, a weight 
factor of 1.4 turned out to be the best choice: the 
solution would benefit from the fMRI constraints in 
such a way that sources at hotspot locations were 
focalized, while the additional source was still 
retrieved. In Table 1 to Table 5, entries with a 
weight factor of 1.4 are emphasized. 

LORETA [5] (Table 5) incorporates lead field 
weighting differently than minimum norm methods, 
as weights are applied to local smoothness measures 
rather than to the source strengths themselves. 


While focalizing to hotspot locations, LORETA was 
not able to retrieve the third source, which is only 
revealed in the unconstrained solutions. 

4. Discussion 

Dipole fits can benefit from fMRI constraints: 
Meaningful seed points for the location fit are 
obtained, a crucial issue in all multi-dipole fits. A 
reconstructed dipole in the vicinity of each fMRI 
hotspot yields the corresponding source time course. 
Spatially unconstrained dipoles are then necessary 
to account for remaining activity. However, the 
temporal discrimination of close sources can only be 
achieved by an additional fixed dipole constraint. 
Current density reconstructions react upon fMRI 
constraints in two ways: Activity in the vicinity of 
fMRI hotspots is bundled. Remaining activity can 
be localized correctly, if its field distribution cannot 
be generated from sources within the hotspots, and 
if the weight factor is not too large. The temporal 
discrimination of close sources is enhanced with 
respect to unconstrained reconstructions, if the 
correct source orientations are dominating within 
the hotspots. 
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Table 1: Minimum Norm Least Squares, SNR = 30. For all MNLS reconstructions, fMRI constraints with 
weights 1.4 focalize sources with corresponding hotspot, while the source without corresponding hotspot is 
still retrieved. 



unweighted 1.2 1.4 1.6 1.8 2.0 5.0 10.0 


Table 2: Minimum Norm Least Squares, SNR = 15 



Table 3: Minimum Norm Least Squares, SNR = 8. Even for this relatively low SNR, all three sources are 
found. The unconstrained solution is extremely smeared due to the high level of noise in the data. 



unweighted 1.2 1.4 1.6 1.8 2.0 5.0 10.0 


Table 4: Minimum Z 7 Norm, SNR = 15. For Z 7 norm reconstructions [6], fMRI constraints with weight 1.4 
focalize sources with corresponding hotspot, while the source without corresponding hotspot is still retrieved. 
The unconstrained solution shows artifacts in the cerebellum, which is typical for very sensitive measures like 
the L r norm. 


X d 



unweighted 1.2 1.4 1.6 1.8 2.0 5.0 10.0 


Table 5: Cortical LORETA, SNR = 15. fMRI constraints focalize sources with corresponding hotspots. There 
is no situation where no ghost sources occur at the third hotspot while the source without corresponding 
hotspot is still reconstructed. 





